kubernetes deployment
Hybrid AI Inferencing managed with Microsoft Azure Arc-Enabled Kubernetes
Cloud native deployment with Kubernetes orchestration has enabled the "Write Once, Deploy Anywhere" paradigm for applications. This application development and deployment model enables scale and agility in today's hybrid and multi-cloud environments. Applications or services packaged as containers can be deployed and managed with the same Kubernetes based eco-system tools in the public cloud, on premise or Edge locations. Microsoft Azure Arc-Enabled Kubernetes (Reference 1) could be viewed as one such ecosystem tool the enables central management of Kubernetes clusters deployed on premises locations or across different public clouds. Kubernetes based offerings from different vendors are supported and they need not be based on Azure Kubernetes Service (AKS) (Reference 2).
Kubernetes Deployment of a Machine Learning Rest API in the Cloud
Pods: They are deployable units produced from a group of one or more similar containers sharing storage and networking resources. Docker containers are orchestrated(Deployed, Scaled and Monitored) within the pods in the node of the Kubernetes cluster. Service: It is the networking interface that makes it possible to interact with the containers running in the pods.